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Abstract 

Objective:  This  study  is  intended  to  advance  patient  safety  by  demonstrating  the 
effectiveness  of  coupling  surveillance  report  performance  feedback  with 
evidence-based  educational  materials  and  other  communications  that  help 
hospitals  identify  priorities  and  methods  for  medical  injury  prevention.  Methods: 
Medical  injury  surveillance  findings  are  reported  semiannually  to  hospitals  to 
support  their  quality  improvement  efforts.  We  developed  educational  manuals  for 
five  priority  medical  injury  topics  that  covered  indicator  definitions,  problem 
scope,  interventions  to  prevent  injuries,  and  evaluation  methods.  Bimonthly 
newsletters  provide  updates.  Evaluation  of  123  hospitals  in  a  randomized 
controlled  trial  with  structured  surveys  and  medical  injury  surveillance  is 
ongoing.  Results:  Preliminary  results  at  29  intervention  hospitals  suggest  our 
approach  resonates  with  stakeholders,  has  the  general  support  of  participating 
hospitals,  addresses  barriers  to  using  information,  and  builds  on  existing 
competencies.  Conclusions:  While  the  impact  of  this  medical  injury  prevention 
educational  strategy  requires  further  evaluation,  the  results  may  guide 
construction  of  performance  reports,  educational  manuals,  and  newsletters  to 
maximize  the  usefulness  of  patient  safety  information. 


Introduction  and  background 

Medical  injuries  with  serious  clinical  and  public  health  consequences  occur 
regularly  in  the  course  of  diagnostic  or  therapeutic  interventions,  as  shown  in 
studies  based  on  medical  record  reviews.1  4  Improving  patient  safety  in  hospitals 
is  a  complex  process  that  requires  receiving  accurate,  usable  data  to  understand 
where  the  problems  he;  having  the  evidence  and  other  information  to  inform 
changes;  and  establishing  institutional  buy-in  to  make  those  changes. 

Evidence  of  effective  interventions  for  the  prevention  of  some  medical 
injuries  has  been  growing  steadily.5  However,  knowledge  of  injuries  and  effective 
interventions  has  not  been  easily  translated  into  clinical  practice  to  prevent  or 
mitigate  the  occurrence  of  injuries  within  the  health  care  system.6 

The  importance  of  data 

A  recent  Institute  of  Medicine  (IOM)  patient  safety  report  stated  that  “better 
management  of  health  infonnation  is  a  prerequisite  to  achieving  patient  safety  as  a 
standard  of  care.”7  Efficient  and  representative  patient  safety  reporting  systems 
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using  valid  data  are  an  essential  foundation  for  development,  implementation,  and 
evaluation  of  effective  practices  in  patient  safety. 

Ideally,  the  data  also  should  be  relatively  easy  to  obtain  and  interpret. 
Individual  hospitals  already  routinely  gather  and  report  administrative  discharge 
data.  While  publicly  available  hospital  perfonnance  data  have  limitations,  their 
usefulness  has  not  been  adequately  explored.  Administrative  data  could  be 
valuable  for  identifying  patient  safety  problems  and  monitoring  the  effectiveness 
of  interventions  to  prevent  the  problems’  occurrence  and  reduce  their  impact, 
especially  when  the  data  are  appropriately  refined,  risk-adjusted,  and 
confidentially  delivered  in  periodic  surveillance  reports. 

Information  to  educate  and  create  buy-in 

Even  when  data  have  these  desirable  properties,  a  single  data  source  is 
insufficient  to  gain  a  complete  understanding  of  medical  injuries.  Additionally, 
these  data  alone  will  not  lead  to  improvement  in  clinical  care.  The  data  must  be 
used  in  a  context  of  other  information,  such  as  clinical  guidelines  and  best 
practices,  and  communicated  throughout  a  system  characterized  by  complex 
operations,  established  organizational  culture,  and  competing  priorities.  Having 
relevant  tools  and  products  closely  accompany  the  injury  reports  is  a  useful 
strategy  because  it  provides  evidence  regarding  the  problem  and  “immediately” 
offers  ready-to-use  solutions,  helping  to  reduce  resistance  due  to  competing 
priorities. 


Objective  and  program  overview 

We  developed  a  multifaceted  demonstration  approach  using  publicly  available 
hospital  discharge  data  to  report  medical  injury  perfonnance  directly  and 
confidentially  to  hospitals.  We  also  examined  the  effects  of  confidential  patient 
safety  surveillance  reports  combined  with  evidence  and  better  practice-based 
educational  intervention  tools  on  quality  improvement  efforts  and  patient  safety  in 
29  Wisconsin  acute  care  hospitals. 

The  objective  of  this  paper  is  to  describe  the  initiative,  the  implementation 
process,  and  observations  that  are  important  for  patient  safety  efforts.  This 
descriptive  paper  serves  two  important  functions  in  patient  safety: 

(1)  It  shows  how  surveillance  reports  can  help  hospitals  to  identify  priority 
areas  for  medical  injury  prevention  and  control. 

(2)  It  demonstrates  the  development  of  education  manuals  that  can  provide 
relevant  information  to  staff  overwhelmed  with  data.  We  provide  scientific 
evidence  and  best  practices  for  five  specific  priority  medical  injury  topics 
in  a  usable  and  accessible  format  for  clinicians  and  hospital  personnel. 

Over  a  2-year  period,  29  intervention  and  60  feedback-only  hospitals  in 
Wisconsin  have  been  receiving  periodic  surveillance  reports  containing  medical 
injury  data  aggregated  for  the  State,  as  well  as  specific  data  to  their  individual 
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facilities.  During  the  second  year  of  the  project,  intervention  hospitals  also 
received  educational  manuals  developed  by  the  Wisconsin  Medical  Injury 
Reporting  System  (WMIRS)  Research  Group.  Each  manual  contains  evidence- 
based  guidelines,  intervention  recommendations,  and  review  articles  specific  to 
the  priority  injury  area,  coupled  with  related  discharge  data  for  their  own  hospital. 
The  intervention  director,  a  registered  nurse,  clarifies  infonnation  in  the  reports 
and  manuals  to  assist  in  the  interpretation  of  the  data  and  application  of  the 
manuals  to  guide  patient  safety  efforts  of  quality  improvement  personnel  in 
hospitals.  Hospitals  continue  to  receive  semiannual  surveillance  reports  plus 
bimonthly  newsletters  to  provide  reinforcement  of  key  guidelines,  and 
intervention  recommendations  and  updates  of  new  information  specific  to  priority 
areas. 

We  expect  that  pertinent,  timely  education  for  hospital  personnel  concerned 
about  protecting  their  patients  will  have  a  positive  effect  on  health  outcomes.  The 
impact  of  this  educational  strategy  for  medical  injury  prevention  and  control  is 
being  evaluated.  Results  of  longitudinal  analysis  of  administrative  data  and 
surveys  of  hospital  personnel  regarding  the  usefulness  and  impact  of  the  reports 
and  intervention  manuals  will  provide  data  to  inform  insight  about  the 
effectiveness  of  this  approach. 

Useful  tools  to  prevent  medical  injuries 

The  conceptual  model  for  the  potential  influence  of  WMIRS  patient  safety 
reports  and  educational  manuals  on  medical  injury  prevention  at  hospitals  is 
depicted  in  Figure  1 . 

Effective  education  is  a  classic  component  of  injury  prevention  and  control. 
Educational  strategies,  including  persuasion,  behavior  modification,  and  social 
influence,  play  an  important  role  in  laying  the  foundation  for  all  injury  prevention 
approaches.9  A  focus  on  preventing  medical  injuries  (rather  than  identifying 
errors)  identifies  more  reliable  data,  avoids  defensiveness,  and  encourages  an 
emphasis  on  patient  outcomes.10  Another  IOM  report,  Health  Professions 
Education,  contended  that  “all  health  professionals  should  be  educated  to  deliver 
patient-centered  care  as  members  of  an  interdisciplinary  team,  emphasizing 
evidence-based  practice,  quality  improvement  approaches,  and  informatics.”11 
These  methods  have  generally  been  found  to  be  effective  in  changing  physician 
behavior.12 

Good  evidence  supports  the  use  of  specific  interventions  to  reduce  the  risk  of 
priority  medical  injuries,  yet  these  strategies  are  not  always  implemented.11  For 
example,  although  several  high  quality,  randomized  controlled  trials  have  shown 
that  perioperative  beta-blockers  reduce  cardiac  events  during  surgery,  they  are 
used  only  36  percent  of  the  time.  We  also  know  that  traditional  continuing 
medical  education  strategies  often  do  not  result  in  practice  change  if  they  take 
place  out  of  the  context  of  a  specific  patient  care  event.  Therefore,  we  couple  the 
provision  of  hospital-specific  patient  safety  data  with  complementary  educational 
manuals  targeted  to  the  five  priority  injury  areas. 
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Figure  1 .  Framework  for  the  influence  of  WMIRS  patient  safety  reports  and  educational 
manuals  on  medical  injury  prevention  at  hospitals 
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Adapted  from  Ginsberg.8 

Employing  an  injury  control  model,  we  use  surveillance  techniques  to  identify 
patient  safety  problems  and  confidentially  report  them  back  to  each  hospital, 
supplementing  the  data  with  educational  materials  that  provide  the  best  evidence 
available  for  effective  interventions  for  change.  These  evidence-based,  quality 
improvement  strategies  include  the  following: 
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•  Audit  of  electronic  hospital  discharge  records  and  confidential 
feedback  summarizing  clinical  indicators  of  hospital  performance  of 
medical  injury  rates  over  a  6-month  period,  with  subsequent 
recommendations  for  clinical  action. 

•  Recognition  of  needs  and  outcomes  assessments  as  precursors  to 
change  and  tools  for  evaluating  results. 

•  Distribution  of  educational  materials  and  printed  recommendations  for 
clinical  care,  including  practice  guidelines  and  reminders  to  hospital 
personnel. 

These  actions  are  supported  by  educational  outreach  visits  by  a  trained  expert 
who  meets  with  quality  improvement  personnel  to  inform  the  use  and 
interpretation  of  feedback  reports  and  educational  manuals,  to  identify  patient 
safety  issues  of  high  priority  in  their  settings  and  “best  practices”  from  their  own 
work,  and  to  solicit  feedback  on  materials  we  have  provided. 


Methods 

For  this  demonstration,  the  WMIRS  group  at  the  Medical  College  of 
Wisconsin  randomized  the  State’s  123  nonfederal,  general,  acute  care  hospitals 
into  three  groups.  For  the  3-year  study  period,  the  control  group  of  34  hospitals 
receives  no  reports  or  interventions.  The  feedback-only  group  of  60  hospitals 
receives  just  the  semiannual  surveillance  reports.  The  intervention  group  of  29 
hospitals  receives  semiannual  surveillance  reports  plus  educational  interventions 
of  five  priority-topic  manuals,  professional  staff  guidance  and  support,  and 
bimonthly  newsletters.  All  reporting  is  confidential.  Feedback-only  and 
intervention  groups  receive  aggregate  data  for  all  State  hospitals  plus  their  own 
information. 

Medical  injury  surveillance  and  reporting 

To  analyze  and  disseminate  hospitals’  patient  safety  data,  we  use  a  new 
approach  developed  at  Medical  College  of  Wisconsin  Injury  Research  Center.  We 
identify  medical  injury  incidence  rates  using  the  Wisconsin  Bureau  of  Health 
Information  Hospital  Inpatient  Discharge  Data  electronic  health  records  and 
validated  diagnosis  code  criteria.14  Screening  criteria  for  medical  injury  are  based 
on  International  Classification  of  Diseases  (ICD-9-CM)  N-code  and  E-code 
discharge  diagnoses.  The  baseline  was  established  using  all  discharges  in  2002- 
2003.  After  the  first  report,  we  began  refining  the  data  based  on  feedback.  The 
data  were  always  risk-adjusted.  We  made  subsequent  changes  to  enhance  clinical 
interpretation  and  address  fiscal  concerns. 

WMIRS  criteria 

The  WMIRS  criteria  are  grouped  into  four  broad  categories:  (1)  procedures; 
(2)  drugs  and  biologies;  (3)  devices,  implants,  or  grafts;  and  (4)  radiation 
complications.  Hospital  reports  contain  tables  of  the  4  categories  and  40  more 
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specific  subcategories  of  medical  injuries.  The  primary  outcomes  reported  are  the 
rate  of  medical  injury  in  discharged  patients  by  category  of  the  screening  criteria, 
the  number  of  cases  or  occurrences  as  well  as  hospital-specific  and  statewide  rates 
per  1000  discharges,  and  percentile  rankings  for  6-month  periods.  Secondary 
outcomes  reported  are  the  impact  of  medical  injury  on  mean  excess  length  of  stay 
(LOS),  percent  increased  LOS,  adjusted  LOS,  and  hospital  charges  by  diagnosis. 
We  apply  risk-adjustment  modeling  to  the  data  and  translate  them  into  a  valid, 
usable  format.  Results  are  adjusted  for  3M  Health  Information  Systems  All 
Patient  Refined  Diagnosis-related  Groups  (APR-DRGs),  severity  of  underlying 
illness,  risk  of  mortality,  and  characteristics  of  the  hospital  of  discharge  (e.g., 
patient  mix,  services  provided,  and  coding  practices). 

Dissemination  of  reports  and  support  of  quality  improvement 

The  chief  executive  officer  and  director  of  quality  improvement  of  each  of  the 
89  eligible  hospitals  receive  the  confidential  WMIRS  reports  semiannually.  The 
reports  contain  medical  injury  rates  from  their  hospital  and  from  all  hospitals  in 
the  State  of  Wisconsin  for  the  previous  6  months.  For  a  subgroup  of  29 
intervention  hospitals,  our  intervention  director — a  registered  nurse  with  expertise 
in  hospital  administration,  quality  improvement,  and  patient  safety — makes 
regular  visits  and  phone  calls  to  hospital  quality  improvement  personnel  to  answer 
questions,  interpret  reports,  and  exchange  information.  She  interprets  reports  of 
hospital-specific  medical  injuries,  interacts  with  hospital  personnel  in  setting 
priorities  and  targeting  areas  for  medical  injury  prevention  and  control,  listens  to 
the  needs  and  wants  of  the  hospitals,  and  advocates  for  their  system 
improvements. 

Selection  of  priority  medical  injuries  and  preventive  interventions 

We  selected  key  medical  injury  topics  for  hospitalwide  intervention  based  on 
the  Agency  for  Healthcare  Research  and  Quality’s  priority  areas  for  national 
action,5  the  frequency  and  severity  of  medical  injury  occurrences  based  upon 
WMIRS  surveillance  reports,  input  from  intervention  hospitals,  and  expert  panel 
assessment  of  the  relative  feasibility  of  potential  interventions.  The  priority  topics, 
definitions,  problem  scope,  and  key  interventions  to  prevent  medical  injuries  are 
listed  in  Table  1. 

Educational  manuals  and  newsletters 

Using  extensive  literature  review  and  examples  of  hospital  best  practices, 
WMIRS  physician  experts  developed  a  set  of  condition-specific  manuals  that 
summarize  research  evidence  and  suggest  practical  strategies  to  prevent  medical 
injuries.  The  overwhelming  and  often  fragmented  amount  of  infonnation 
regarding  medical  injury  prevention  is  condensed  to  a  focused,  organized  product 
the  hospitals  can  easily  understand  and  use. 
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The  educational  manuals  are  presented  in  a  cycle  framework  that  is  familiar  to 
quality  improvement  personnel.26  In  this  way,  the  data  and  suggestions  for 
interventions  are  integrated  into  a  tool  designed  to  assist  hospital  personnel  as 
they  compile  and  interpret  their  patient  safety  data;  detennine  their  own  needs  and 
priorities;  establish  goals;  and  plan,  implement,  and  evaluate  efforts  to  prevent 
medical  injuries.  In  addition  to  intervention  recommendations,  key  references  are 
included  to  inform  steps  in  the  quality  improvement  framework.  For  example,  we 
reinforce  the  1996  Joint  Commission  on  the  Accreditation  of  Healthcare 
Organizations  (JCAHO)  sentinel  event  policy  that  requires  investigation  of  the 
causes  of  adverse  events  such  as  medical  injuries  using  root-cause  analysis  and 
monitoring  the  effectiveness  of  strategies.  The  key  elements  and  contents  of 
manuals  are  noted  in  Table  2. 

Table  2.  Key  contents  of  the  educational  manuals  to  prevent  priority  medical  injuries 


1.  Introduction 

Models  of  process  change:  plan,  intervention  (do),  evaluation  (study),  revision  (act). 

2.  Plan  for  prevention:  measure,  analyze,  and  review  prior  research  and  baseline  data;  identify 
areas  for  improvement;  establish  goals;  and  plan  for  change,  i.e.,  create  a  culture  of  inquiry: 

•  Scope  of  the  problem. 

•  Confidential  WMIRS  data:  baseline  injury  rates  and  most  frequent  injuries  and  most 
frequent  procedures  associated  with  injury  codes  in  Wisconsin  hospitals  according  to 
discharge  diagnoses  and  priority  intervention  indicators. 

•  Using  discharge  codes  and  chart  reviews  to  investigate  processes  associated  with  specific 
injuries. 

•  Add  own  hospital-specific  monitoring  data  from  hospital  staff,  chart  reviews,  and  Ql 
initiatives. 

3.  Intervention:  evidence  and  tools  for  effective  strategies  to  reduce  injuries: 

•  General  guidelines  and  specific  patient  safety  recommendations  to  prevent  specific 
targeted  injuries. 

•  References,  systematic  scientific  review  articles,  specific  guidelines,  predictors  of  medical 
injuries,  randomized  controlled  trials,  clinical  applications,  practical  innovations, 
standardized  protocols,  hospital  clinical  pathways,  performance  measures,  process-of- 
care  steps. 

4.  Evaluation:  assess  impact  of  intervention  efforts  and  disseminate  findings: 

Add  WMIRS  confidential  hospital-specific  follow-up  reports  as  well  as  own  hospital  post¬ 
intervention  monitoring  data,  e.g.,  processes  of  care,  outcomes  reports,  chart  reviews,  root-cause 
analyses,  barriers  to  implementation,  and  reactions  of  stakeholders  (medical  staff,  nurses, 
administrators,  and  patients). 

5.  Revision:  plan  for  future  action  based  upon  evaluation  and  evidence-based  practice: 

•  Draw  conclusions. 

•  Communicate  findings  to  stakeholders,  e.g.,  economic  benefits. 

•  Modify  approaches  or  standardize  changes  to  maintain  gain. 

•  Continue  monitoring. 

•  Identify  new  priorities  for  future  interventions  using  best  practices  and  benchmarks  of 
WMIRS  intervention  hospitals. 
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Follow-up  newsletters,  sent  bimonthly,  are  designed  to  reinforce  the 
educational  manuals  and  provide  practical,  evidence-based  resources  for  patient 
safety  interventions.  Each  newsletter  contains  a  timely  lead  article,  a  question- 
and-answer  section,  and  three  additional  features.  The  “Toolbox”  section  lists 
Web  sites  and  resources  to  promote  patient  safety,  such  as  the  National  Patient 
Safety  Foundation  and  the  National  Guideline  Clearinghouse.  The  “In  the 
Spotlight”  column  highlights  hospitals  that  share  their  successes  in  implementing 
new  safety  standards  within  their  organizations.  The  “Coders  Corner”  provides 
answers  to  coding  concerns,  such  as  the  overuse  of  unspecified  or  nonspecific 
codes. 

Evaluation 

Our  evaluation  is  designed  to  ascertain  whether  demonstration  project 
hospitals  that  receive  patient  safety  reports  and  intervention  tools  have  a  greater 
reduction  of  medical  injuries  over  time,  compared  to  those  hospitals  that  do  not 
receive  the  reports  or  tools.  Further,  the  evaluation  strives  to  determine  whether 
the  patient  safety  information  and  intervention  tools  are  perceived  as  useful  and, 
thus,  are  disseminated  and  used  to  reduce  medical  injuries.  Evaluation  data 
include  extensive  field  notes  by  the  intervention  director  during  her  encounters 
with  hospitals  and  collection  of  data  in  structured  surveys. 

Structured  surveys 

We  developed  a  set  of  surveys  to  be  completed  by  Wisconsin  hospital  quality 
improvement  directors.  Survey  questions  for  the  feedback  group  pertain  to  the 
perceived  usefulness  of  the  performance  data,  and  questions  for  the  intervention 
group  relate  to  the  perceived  usefulness  of  both  the  performance  data  and 
educational  manuals.  The  surveys  are  designed  to  detennine — 

•  Characteristics  that  contribute  to  perceptions  of  usefulness  of  the 
WMIRS  data  and/or  manuals. 

•  The  level  of  dissemination  of  these  materials. 

•  Hospital  personnel  reports  of  the  degree  to  which  the  data  and/or 
manuals  influenced  their  patient  safety  activities. 

Results  will  be  added  to  existing  conceptual  frameworks,  allowing 
comparisons  among  the  three  hospital  groups  to  detennine  whether  receiving 
WMIRS  perfonnance  data  and/or  educational  manuals  is  associated  with 
differences  in  reported  levels  of  intervention  activity  in  a  variety  of  patient  safety 
areas,  including  actual  rates  of  medical  injury  diagnoses. 

Surveillance  using  priority  injury  indicators 

Specific  ICD-9-CM  codes  were  identified  to  capture  occurrences  of  our  five 
high  priority  injuries.  Table  1  lists  the  priority  injury  indicators  for  this  project. 
Following  receipt  of  all  five  educational  manuals,  intervention  hospitals  received 
an  additional  table  as  part  of  their  performance  feedback  report  that  notes  their 
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own  rates  of  injuries  using  these  indicators.  These  individual  hospital  rates  of 
injury  will  be  followed  over  time  for  all  three  hospital  study  groups  to  assess  the 
effectiveness  of  the  feedback  and  intervention  strategies. 

A  key  measure  of  the  impact  of  intervention  will  be  the  comparison  of 
medical  injury  rates  in  the  intervention  and  feedback-only  hospital  groups  with 
that  in  the  control  group.  The  impact  of  the  feedback  component  of  the 
intervention  will  be  assessed  by  comparing  the  medical  injury  rate  in  the 
feedback-only  hospitals  to  that  in  the  control  group,  whereas  the  impact  of  other 
components  of  the  intervention  will  be  assessed  by  comparing  the  full 
intervention  group  to  the  feedback-only  hospitals.  All  analyses  will  adjust  for 
differences  in  hospitals  among  the  groups  being  compared,  including  the  range  of 
services  being  offered  and  coding  practices  of  the  hospitals,  as  well  as  differences 
in  patient  mix  as  measured  by  the  APR-DRG  indices  of  severity  of  illness  and  risk 
of  mortality.  Analyses  will  also  take  into  account  the  clustering  of  data  within 
hospitals.  A  series  of  different  measures  of  medical  injury  occurrence  will  be 
used:  any  medical  injury,  four  major  categories  of  medical  injuries  (drug,  device, 
procedure,  and  radiation),  and  measures  designed  to  reflect  medical  injuries 
sensitive  to  each  of  the  five  educational  manuals. 


Preliminary  results  of  hospital  interventions 

Based  on  feedback  from  hospitals  to  our  intervention  director,  the  perceived 
usefulness  of  the  WMIRS  patient  safety  reports  has  been  positive,  overall. 
Throughout  the  project,  a  number  of  issues  have  been  identified  that  either  foster 
or  impede  use  of  WMIRS  data.  The  first  advantage  of  these  data  is  that  they  place 
no  additional  reporting  burden  on  the  hospital  or  health  care  providers  and, 
therefore,  personnel  were  more  open  to  their  use.  Second,  research  project 
personnel  reviewed  the  initial  reports  in  detail  with  hospital  personnel  until  they 
were  comfortable  with  the  interpretation  of  the  data.  Third,  the  data  were  analyzed 
with  a  sophisticated  risk-adjustment  model.  This  influenced  the  perceived  quality 
of  the  report  because,  although  some  hospitals  examine  their  own  discharge  data, 
they  typically  lack  the  expertise  to  sufficiently  adjust  them  for  risk.  Based  on 
preliminary  data,  being  able  to  direct  the  report  to  a  patient  safety  committee 
appears  to  facilitate  report  use.  Additionally,  community-based  hospitals  that  are 
large  enough  to  have  a  substantial  number  of  injuries  but  are  too  small  to  have 
adequate  patient  safety  and  quality  improvement  resources  in  particular  seem  to 
place  high  value  on  the  reports. 

Of  the  factors  that  appear  to  impede  the  use  of  the  reports,  first  is  an  excessive 
volume  of  infonnation.  Most  quality  improvement  personnel  voiced  concern  over 
the  sheer  number  of  performance  reports  passing  across  their  desks.  Some 
hospitals  elected  not  to  participate  in  the  project  because  they  felt  “overwhelmed” 
with  the  number  of  data  initiatives  with  which  they  were  involved.  Although  most 
hospitals  have  fairly  sophisticated  and  well-integrated  data  systems  for  fiscal 
outcomes,  most  do  not  have  equally  functional  clinical  information  systems. 
Moreover,  additional  resources  are  often  required  to  “drill  down”  data  in  the 
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report;  and  the  cost-driven  reduction  of  quality  improvement  personnel  in  some 
hospitals  prevents  this  from  occurring.  A  second  factor  is  the  lag  of  approximately 
1  year  from  the  time  the  data  are  collected  to  the  time  they  are  released  by  the 
State,  then  analyzed  and  reported  to  hospitals  by  WMIRS.  This  presents 
challenges  in  linking  hospital  interventions  with  the  injury  report.  Finally,  quality 
of  discharge  data  is  heavily  dependent  on  coding  quality,  thereby  preventing  strict 
comparisons  among  hospitals. 

Rates  of  medical  injuries  and  formal  survey  results  by  study  groups  are 
pending. 


Discussion 

Academic  institutions  may  provide  valuable  resources  for  hospitals  by 
reporting  discharge  data  in  a  usable  fonnat  while  maintaining  rigor,  validity,  and 
confidentiality.  Data  alone  may  be  insufficient  to  drive  hospital  safety  efforts. 
Combining  reports  of  severity-adjusted  medical  injury  data  with  complementary 
manuals,  including  evidence-based  strategies  and  frameworks  for  guiding 
systematic  quality  improvement,  may  have  synergistic  results.  Screening  criteria 
applied  to  hospital  discharge  diagnoses  can  identify  frequently  occurring  medical 
injuries  that  have  substantial  impact.  They  also  ultimately  may  serve  to  target 
efforts  aimed  at  identifying  the  causes  and  reducing  the  frequency  of  medical 
injury. 

In  2001,  JCAHO  patient  safety  standards  required  hospital  leadership  to  create 
a  nonpunitive  culture  of  safety  with  routinely  conducted,  organization-wide 
assessment  of  risk  and  regular  reports  to  the  hospital  board.  According  to  the 
IOM’s  Crossing  the  Quality  Chasm,  “Health  care  organizations  [should]  design 
and  implement  more  effective  organizational  support  processes  to  make  change  in 
the  delivery  of  care  possible.”6  Furthermore,  the  IOM’s  To  Err  Is  Human  report 
recommended  that  “health  care  organizations  and  the  professionals  affiliated  with 
them  should  make  continually  improved  patient  safety  a  declared  and  specific  aim 
by  establishing  patient  safety  programs.”27 

The  WMIRS  interdisciplinary  intervention  model  aims  to  assist  hospitals  with 
performance  feedback  and  educational  tools  to  advance  their  patient  safety 
programs.  Our  WMIRS  research  team  comprises  physicians  and  a  nurse. 
Experience  spans  family  and  community  medicine,  pediatrics,  emergency 
medicine,  and  surgery.  Researchers  have  expertise  in  epidemiology,  biostatistics, 
sociology,  health  services  research,  management,  and  public  health.  The  wide 
variety  of  clinical  experience,  as  well  as  familiarity  with  multiple  research  and 
intervention  methods,  allow  a  broad  spectrum  of  injuries  to  be  addressed  using 
many  different  strategies.  On  the  hospital  side,  key  personnel  involved  with  the 
project  include  quality  improvement  managers  and  directors,  top-level 
administrators,  and  nursing  and  medical  directors.  Similar  clinical  and 
management  education,  experiences,  and  perspectives  foster  communication 
between  the  researchers  and  hospital  personnel.  However,  many  hospital 
personnel  lack  extensive  scientific  training  and  consequently  may  have  difficulty 
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understanding  methods  such  as  risk  adjustment.  The  role  of  the  intervention 
director  includes  facilitating  such  understanding. 

Past  research  has  identified  many  factors  that  influence  perceived  usefulness 
of  performance  reports.  These  include  dissemination  intensity,  past  experience 
with  data,  performance  achieved,  and  organizational  culture,  ’  as  well  as  the 
characteristics  of  the  data:  quality,  source  credibility,  report  complexity, 
timeliness,  appropriate  unit  of  analysis,  and  ease  of  use.  Similarly,  the 
effectiveness  of  intervention  tools  is  thought  to  be  contingent  upon  such  factors  as 
quality  and  complexity  of  guidelines,  characteristics  of  the  health  care 
professionals,  and  social  norms.29' 30  Observations  made  in  our  intervention 
director’s  field  notes  suggest  that  factors  such  as  hospital  size,  information 
exclusivity,  availability  of  human  resources,  and  risk  adjustment  of  the  data  may 
also  play  a  role  in  perceived  usefulness  and,  in  turn,  in  the  likelihood  of 
dissemination  and  the  translation  of  information  into  meaningful  changes  in 
patient  safety. 

This  surveillance  and  reporting  system  using  administrative  patient  discharge 
data  avoids  any  additional  reporting  burden  for  health  care  providers  and  may  be 
more  comprehensive  and  feasible  than  systems  relying  on  voluntary  reports  by 
health  care  professionals.  We  provide  hospitals  with  important  measures  of 
medical  injuries  that  are  scientifically  sound  and  robust.  Coupling  this 
performance  feedback  with  evidence-based  educational  resources  is  a  new  model 
to  promote  medical  injury  prevention. 

Limitations 

Because  we  have  analyzed  field  data  only  from  a  small  number  of  hospitals, 
we  have  little  objective  infonnation  about  the  limitations  of  this  approach  that 
couples  perfonnance  feedback  with  evidence-based  educational  resources  to 
reduce  medical  injuries.  Many  of  these  limitations  stem  from  the  inability  to  test 
the  assumptions  underlying  the  interventions.  We  assumed  that  hospital 
personnel — 

•  Have  knowledge  deficits  about  medical  injuries  and  preventive 
interventions  and  that  the  deficits  can  be  remedied  with  our 
educational  manuals. 

•  Would  prefer  sharp  and  concise  materials  that  achieve  a  balance 
between  easy-to -understand  references  and  broad  information. 

•  Are  overwhelmed  with  data  and  may  lack  organizational  systems  to 
integrate  medical  injury  information  with  other  sources  of  data  and 
tools  for  prioritizing  improvements. 

•  Would  act  on  evidence-based  information  provided  directly  to 
responsible  individuals  to  influence  complex  processes  of  hospital 
care. 

However,  we  are  external  change  agents  who  are  not  privy  to  the  politics  and 
complexities  of  the  hospital  environment,  and  thus  our  ability  to  influence 


249 


Advances  in  Patient  Safety:  Vol.  4 


improvements  is  limited.  The  ideal  alternative  might  be  employing  an  internal 
change  agent  in  each  hospital,  such  as  a  quality  improvement  director  who  has 
established  credibility  and  influence  with  a  standing  patient  safety  committee  and 
medical  staff  leaders. 


Conclusion 

By  demonstrating  the  effectiveness  of  coupling  performance  feedback  with 
evidence-based  education  resources,  we  intend  to  advance  patient  safety  from 
research  to  implementation.  Our  approach  resonates  with  stakeholders,  has  the 
general  support  of  participating  hospitals,  recognizes  and  addresses  barriers  to 
using  information,  and  builds  on  existing  competencies  in  data  reporting.  The 
results  of  the  ongoing  study  may  serve  to  guide  construction  of  performance 
reports,  educational  manuals,  and  newsletters  to  maximize  the  usefulness  of 
patient  safety  information  to  ultimately  prevent  and  reduce  medical  injuries.  The 
impact  and  value  of  the  described  medical  injury  prevention  educational  strategies 
will  be  evaluated  further. 
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